DOCUMENT 



RESUME 



PS 001 252 



ED 022 559 

By-Garfunkd, Frank 

HEAD START EVALUATION AND RESEARCH CENTER. BOSTON UNIVERSITY. REPORT A-IIl OBSERVATIONAL 
STRATEGIES FOR OBTAINING DATA ON CHILDREN AND TEACHERS IN HEAD START CLASSES. (OSOD). 

Boston Univ., Mass. 

Spohs Agency- Office of Economic Opportunity, Washington, D.C. 

Pub Date 1 Sep 67 
Note- 30p. 

EDRS Price MF-S025 HC-S128 

Descriptors- ♦BEHAVIOR RATING SCALES, CLASSROOM COMMUNICATION, ^CLASSROOM RESEARCH 
CURRICULUM EVALUATION, FILMS, MEASUREMENT INSTRUMENTS, ♦OBSERVATION, PEER RELATIONSHIP, 
PRESCHOOL CHILDREN. PRESCHOOL TEACHERS, PROGRAM EVALUATION, ♦RESEARCH PROJECTS, ♦STUDENT 
TEACHER RELATIONSHIP, TEACHING STYLES 
Identifiers-^Head Start 

With the purpose of obtaining relevant data about the curriculum, dassroom, 
teacher, and peer effects on individual Head Start children, this project plans to have 
trained observers spend several hours in the classroom (1) attending to and 
recording the total functions of the dass and (2) attending to and recording the 
behavior of individual children. A comprehensive, somewhat complex, system of rating 
teacher-child behavior and dassroom activities has been devised to record the data. 
Exploratory observation and training of observers will precede the primary data 
gathering project. There are plans to film the dassrooms being observed in order to 
reconsider as a whole what the observers, by their rating scales, pulverize into many 
pieces of data. The analysis of the da la will be directed towards developing specific 
predictions for individual children, dasses, and dusters of dasses regarding effects 
of various kinds of programs on children. CWD) 




u S DEPARTMENT OF HEALTH, EDUCATION & WELFARE 
OFFICE OF EDUCATION 



« 



► 



THIS DOCUMENT HAS BEEN REPRODUCED EXACTLY AS RECEIVED FROM THE 
PERSON on ORGANIZATION ORIGINATING IT. POINTS OF VIEW OR OPINIONS 
STATED DO NOT NECESSARILY REPRESENT OFFICIAL OFFICE OF EDUCATION 

position or policy. September 1, 19o7 




Frank Garfunkel 
Boston University* 



Head Start Evaluation and Research Center 
B6st0ft‘iUniveraitv 



OBSERVATIONAL ’ • STRATEGIES FOR OBTAINING 
DATA ON CHILDREN 7 AND • •TEACHERS IN ^flfc5T"?TART 

CLASSES COSOD) 



Curriculum 

Classroom .organization 
Teacher style 
Child reactions 
Communication patterns 



Acknowledgement 

These Instruments were developed with the active. cooperation of Dr. 
Carolyn Stern, Director, U.C.LoA* Head Start Evaluation and Research Center 

f f 

and her staff, and drew heavily on instruments that had been developed, or 
partially developed .in Head .Start E*. &..R* Centers at U*C*L*A*., .Banks Street 
College of Education, University of Texas and Boston University* 



u 

ERIC 



TABLE OF CONTENTS 

INTRODUCTION - 2 

STRATEGIES * 

Instructions for recording 
CURRICULUM PROTOCOL 

Class .. .. 6 

Child •••• ••»«••••••••••••••••••••• 11 

BEHAVIOURAL CATEGORIES 12 

TIME VARIABLES ' 13 

TEACHER ~ BEHAVIOURAL STYLE . 13 

CURRICULUM PROTOCOL 15 

Key for CURRICULUM PROTOCOL 16 

BEHAVIOURAL PROTOCOL 19 

TIME VARIABLES PROTOCOL 19 

TEACHER BEHAVIOURAL STYLE PROTOCOL 20 

BEHAVIOURAL CATEGORY . SCALES * 21 

TIME VARIABLES' SCALES 22 

Tims allotments and sample size for teacher, class and 
curriculum observation 

CURRICULUM . PROTOCOL 23 

Individual child .observation 23 

Exploratory obaervation..and training 26 

Selection of observers 27 

Analysis of observational data 27 



INTRODUCTION 



The instruments to. be described herein .have been .developed to obtain 
relevant data, about the .curriculum^, classroom* teacher and peer effects on. 
individual Head Start children, . .The. techniques were developed to. study. ..seem* 
ingly important. sources of. variation* Since the.:latter. . dominated theifarmer., 
there are. a.variaty of -methods-employed,. each, of which. .would. appear to .be . 
most suitable. .f or. .studying.:a. corresponding, parameter* Therefore ,..methadalo? - 
gies vary according. . to . the nature, .of „ the. variable-being measured* 

No. mingle, strategy .will., satisfy . the. diversity. -of •„ situations* teachers* 
methods „ .classroom organizations, adult interactions and activities to be 
found in Head Start and other levels and kinds of classrooms* Following 
around teachers might be appropriate in some cases but, too ‘often, the teach- 
er might have two rooms, administrative duties, or perform special functions 
in the classroom which would not lead to comparability* Observing the whole 
class prevents attention to important details of individual interaction*, be- 
tween children and between teachers and children* Selecting the seemingly 
important incidents that .come, to the attention of observers is fraught with 
several kinds of biases - those due to importance and selectivity* Further- 
more, it has become more and more apparent that we should be directly at- 
tending to the impact of adults. in the classroom as they come in contact 
with children. On the other hand, we cannot ignore the organization and sub- 
stance of the class* 

Therefore, a dual strategy has been developed*. There is, admittedly, a 
gap* The curriculum protocol * when used with the total class, can only go so 
far and it has been pushed to .its limit. Following individual children around 

can be disconcerting to the observer because of a concern for behaviours that 

, • • • » 

are observed but cannot be recorded* 
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At any rata, unbiaaed sampling , - over. tine, should .give bast estimates 

for individual children (so that .this might* be considered as a lector in the 

. . . ' * 

change of Individual, children ovar time) and also, the ratings and tiaes can 
be accumulated over- children in a given class ..so that we can have central 

tendency measures for the class .with .respect to ,tha accumulation of Individ- 

• # 

ual behaviours of children vis-a-vis teachers and other children* 

The important thing .to see, in order to understand the power of the in- 
strument, are the ways in .which two, three and four scales can be interrelated 
in order to gat at store complex. effects. 

The most critical- scales -. (process - focus and control) are crucial to both 
strategies . so they must be clearly. understood by the observer. They will, 
of course, be controlled by other .scales (participation which will be medi- 
ated by child behaviour and . teacher style) «. 

The strategy does not preclude the use of anecdotal reports. Once an 
observer has mastered the system (gains fluency) recording will be done in 
a matter of seconds and there » will .be more than enough time to take notes on 
individuals and dasftroom situations. Readers can fill out protocols from the 
anecdotal report and disparities can be studied. 

Validity 

We have several questions: Do the scales have face (or construct) validity? 

i 

Do they include important variables that do make a difference? Is the content 
sufficient to differentiate quality from mediocrity? Are there any Important 
ommlssions which would prevent the scales from giving a valid estimate of 
potential Impact? 

This is being done by having individuals with diverse views review the 
content and discuss it. It also can be done conjecturely by comparing the 
content of the scales (in terms of second order interactions - taking two 
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and thraa variables ..at a time) to hypothetically auparior and inferior classes* 
including those that may not. fit any .given model in all respects. 

Empirical validation .will not , be -possible in any short period of time. 
However, an empirical test of .the internal validity of the scales is necessary 
if they are to be used on any. large scale. This involves using multiple ob- 
servers in at least twenty classes. 

Strategies 

There are two tasks to be done in order to complete these scales: 

1. Observer (0) spends one, two or three hours in classroom, on 
two, three, or four separate days, attending to total functions of class. 
Two entries are made every .five minutes, which approximates two and one 
half minutes per entry, but it leaves the observer some flexibility. 

All teachers, aides, volunteers and student teachers are observed work- 
ing (or not working) with all children. The aim of this is to get at 
classroom organization and curriculum. In addition to the time dimen- 
sion, the number of children in any given activity is a basic dimension. 

2. Observer spends one, two or three hours in classroom and at- 
tends to one child at a time for periods of ten minutes. Each child is 
observed on two, three or four separate days. Entries are made every 
thirty seconds; at the end of ten minutes seven judgments are made re- 
garding selected teacher characteristics. The thirty-second entries in- 
clude category ratings ( 5 ) and the recording of the presence of three 
behaviours. 

Protocols and coding sheets are notated with letters and subscripts so 
that it will make it easy to refer to them. An index of protocols and keys 
follows (see pp. 14-21) : 
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A* Curriculum Protocol for 20 minute observation of class. Three of 
these will be- needed -for* each- hour- of* observation. This is used 
for recording activities .of total .class and also , but. by a differ- 

t •« 

ent observer, fpr recording activities of individual child when he 
is observed for ten minute segments. 

B* Key for scoring A when used either for toal class , or for individual 
child* JB consists of . three curricular classifications which are 
subdivided into five scales* This is meant to be an all-inclusive 
and mutually exclusive category system, i*e», everything that can 
occur in a preschool, classroom is .included, and included only once. 

Cl Protocol for category entries for observation of individual child 
on five scales directed. variously at order of activity, teacher- 
child relation, child and teacher. Entries are to be made once 
every thirty seconds on .all five scales. Child ratings will be made 
on a previously designated child. Teacher ratings will be made on 
teacher who is attending to child at time of observation. If sev- 
eral adults interact with child, then they are all included at the 
appropriate time. This is not meant to be a record of any one teacher's 
or aide's behaviour, but rather of the behaviours of any adults that 
come in contact with the child. This then becomes a sample of the 
behaviours of all .teachers with all children. 

C2, This protocol includes .four scales which ask for the recording of 

the presence of teacher-child and child-child attention and communi- 
cation interactions ..within fifteen second intervals. A distinction 
is made between attention and verbal communication. 

C3 Protocol for rating interaction of adult with child during ten min- 
ute period. If more than one adult interacts with child, rate the 



adult who has attended. .to -him the longest* If several adults have inter- 
acted equally , take the. first one. Checks can be entered in appropri- 
ate cells whenever. givan..behaviour occurs or does not occur, and the 
summary rating can be made at the end of ten minute interval* Ratings 
are made after every ten minute observation of child* 

Dl Coding sheet for Cl* Includes categories within scales* All scales 
range between 1 and..5 . except scale number 5,, which includes an 0 entry 
for the situation when..no . teacher is attending to or ignoring the child 
in, a given time interval* 

D2 Description of scales . in. C2 . 

Except for C3 . all entries are made consecutively at prescribed intervals, 
throughout stipulated time periods*. This means that observers will have to be 
quite fluent with scales, categories, notation and the range of values of each 
scale. Once this fluency is obtained, the observer will be able to fully attend 
to class, teachers and children or .child, without continually referring back to 
coding sheets* Movies can. provide u an excellent way of gaining fluency, except for 
the classroom use of the curriculum.protocol* A library of ten-minute sequences 
on individual children has been developed in order to train observers and obtain 
rater agreement data* 

INSTRUCTION FOR MAKING ENTRIES INTO CURRICULUM PROTOCOL 

FOR 20 MINUTE . . OBSERVATIONS OF CLASSES (see pp. 15-18) 

Five unit entries are to .be. made at approximately every two and one half 
minutes, or two entries each .five minutes. Activities that take under two min- 
utes are excluded. Periods of rapid change are recorded partially by putting X f s 
into unscoreable categories*. For ..example, if a child switches activities for four 
or five minutes, entries are made where they reflect behaviour that lasts over two 
minutes. X'a are entered where rapid changes do not permit a single entry for the 
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interval. If a child la switching on all categories, the recording would be five 
X'a. If ha la fairly constant in any ona, it would ba coded and the othara would 

ba X'a. 

Observer continuaa. to make entriee at two and one half minute intsrvala 
throughout designated time. period. .Each protocol covara twenty minutes. If an 
obssrvar stays for thrsa hours in a.class, ha can fill out nine protocola, or, if 
tan minutes Is taken between each protocol, ha can fill out six protocols, two 

hours of . recording* in a. three '.hour -period. 

Kay B, is a category system to bar used for making entries into the curriculu m 

nrotocol (£).’ 

Each entry will consist . of five units which can be made alphabetically or 
numerically. The numerical will.be.easier for punching cards, but the alphabetic 
system may be easier for the observer-recorder, particularly during the training 

period . 

A five unit entry will be made for each activity that goes on for over two 
mlnutee and leas than three minutea. If an activity goes on for over three min- 
utes, then it ie recorded again with appropriate changee, including a change in 
scale 5, from 1 to C. When an activity terminates, the last entry for scale 5 

will bs s T. 

An sntry will be made in s given time interval fr?r every separate activity 
going on, no matter how many children are involved a Therefore, the number of en- 
tries can be equal to the number of children if all children are engaged in sep- 
arate activities. If a number of children are doing substantially the same thing, 
but not in a group (either completely separately or a parallel play or activity) , 
then it is only necessary to make one five unit entry and put a circled number 
underneath it, indicating the number of children involved. Entries will be made 
in columns indicating sequential time intervals, and in rows indicating the num- 
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bar of childran involved in an activity* Nota that thara la vary llttla apaca 
allottad to Total Claaa bacauaa thara can be only ona antry thara, and thara la 
much morn apaca allottad -to Individual and Diada and Trlada bacauaa thara can ba 
numaroua antrlaa and mora apaca may ba naadad* Thua, In any ona column thara c^n 

ba aa fair aa ona antry (If tha total group la lnvolvad) and aa many aa tha nua- 

! 

bar of childran In attandanca (if aach child la doing aomathlng dlf f arant) • 

Nota that thara ara five column* In aach tiro and ona half mlnuta tiaa aag- 
mant. Tha flva apaca* for any glvan activity will ba f Iliad with flva valuaa 
corraapondlng to tha flva numbarad column* of B. Tha flrat unit of aach antry 
will ba ona of tha primary catagorlaa from column ,1 of B,. Thua tha obaarvar wi'l 
hava to aalact a moat approprlata primary catagory (Co or Pa or Py or Un or Sc 
or £Di or Aa or S2. or 5a or or IS) dapanding on what ia going on for a particu- 
lar individual or group* (It la not nacaaaary to coda curricular cla**iflc*tion 
[column 0] aa wa can do that latar* Thla column la for tha logical convanlanca 
of tha obaarvar ao that ha can focua on tha moat approprlata primary bacauaa of 
tha logical oparational focua of tha curricular claaaificatlon . Nota that jg£i- 
mariaa ara numbarad from 1 to 11, 1, to 3, baing undar Activity focua . £ to 2 balng 
undar Subatantitlva focua . and & to 11 baing undar Routinaa * I have addad an 0 
undar Activity focua bacauaa. of t?a llkallhood that aoma childran vill ba wandar- 
ing around and it will not ba poaaibla for tha obaarvar to atipulata a primary *) 
For aach primary , raapactlvaly, thara ara corraapondlng aacondarlaa * For 
Activity focua aach primary haa unlqua aacondarlaa * For Subatantiva focur, (II) 
tha aacondarlaa cut acroaa all prlmarlaa* Tharafora, for II, aach primary la 
rat ad Tx or Da or Ex * (Thla ia prafarabla to having unlqua aacondarlaa- for aach 
primary , aa it parmlta croaa tabulation acroaa primariaa *) 

Procaaa focua . control and aaouanca (column* 3 > L *nd S) *11 cut acroaa pri- 
mary-aacondary antrlaa* Thua, no mattar what tha primary or aacondary , a catagory 
of procaaa (Cg, or Sg or Mg or Ng) , and a catagory of control <A or H °* £) » *»<* a 
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category of sequence (I or. C or. T).must. be. selected. and. entered into an appropri- 
ate cello 

Now to. give. a. few: examples*.. If a group, of. three, children are with a teacher 
constructing wooden boats* under. the direction of the teacher, where the purpose 
is to construct the boats and . teach the- children to use simple tools, aud this 
activity has been going, on for over ..three minutes, then the coding would be: Co/ 

Fu/Sk/ P/Co. From this entry , it .follows that the activity is activity focused , the 

activity being cons t rue t ion , the. secondary designation being functional , the pro- 

\ • -- • " 

cess focus being skill ; the control being with the. teacher and the sequence be- 
ing continuing . The entry would .be made in the second row (from the top) • 

If a. child were wandering around picking fights with other children without 
supervision from a teacher, and if. .this activity persisted for at least two minutes, 
then the entry to be made when this began (for the first two minutes) would be 
Un/In/So/ A/I. The entry would be made in the first row as the child is acting 
individually. 

If the total class is listening to a. story, read by the teacher where the> story 
is an end in itself, and there ..is no elaboration, and it is in its last two min- 
utes, then the entry is made„in the -bottom row and is Pe/Dp/Me/P/T. 

On the other hand, if there is -.an obvious attempt on the part of the teacher 
to elaborate the story, explain vocabulary,, question the children on what is hap- 
pening, then the entry is La/De/Co/P/T 0 

For convenience we will., ref er~.to. scales by curricular classification number 
(a Roman numeral) and the column number. Thus, II-3 is the process, focus scale 
under substantitive focus. 

All scales under column JL are. strictly nominal - there is no implied order- 
ing. Scales under column 2, are nominal except for II-2, where there is an ordinal 
hierarchy. The value recorded Cor the coded alphabetical symbol) should be the 
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"highest" observed during, thee time interval. There is an implied order in III - 2. 
elaborative being a higher. level than functional * Again, the highest level is 
dominant, and if it takes. place: during .the Interval it should be so coded. 

Process- focus scale :.is partially ordinal. In the following order, from lowest j 
to highest, in parenthetic. clusters i (Mg); (Sk . Pe) ; (Co. So). Thus, if manipu- 
lative skill training la present, but there is also a noticeable amount of at- * 

■■ .i, 

tention to co-op sr at ion rand isharing, .then the higher level (So) would be entered. 

In order for the higher level activity to be entered. It must be more than a pas- 
sing rwark, question or answer* It has tor be eustained and children must be 
responsive*. 

Control scale (column 4) is clearly ordered. Assigned value should reflect 
dominant influence on activity, not .simply presence or absence. 

Sequence (column 5) is a simple sequential scale. 

The bottom row of the protocol has space for entering attendance during each 
interval. If children, stagger in during the first hour, this will change during 
each time interval. Attendance includes all children present during the given 
interval, no matter what they are doing or where they are doing it, just so long 

as they are a part of . the class.. 

* 

In the row labelled Adults , record number of adults with class during each 
time interval. 

The principal problem of this. procedure will be for highly differentiated 
classes where many children are functioning individually or in diads and triads. 

This will be particularly troublesome when there is more than one room or when a ^ 
lot of the activity takes place in.a large outside area. IN SOME CASES WE MAY 
NEED TWO OBSERVERS, dividing up the .area, so that they can give justice to indi- 
vidual and small group activity. 
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INSTRUCTIONS.; ,EOit. ■ :-MAKIHG:: - ENTRIES:: INTO * CURRICULUM PROTOCOL FOR 
TEN MINUTE VIOBSERV&TIONS" OF’ INDIVIDUAL CHILD USING 

CURRICULUM PROTOCOL £A) (see pp. 15-18) 

The same protocol as is used to .describe- the curriculum of the class is used 

to describe the- curricular .activities*. of a child at the same time that scales Cl, 

/ - ■ 

* • »« 

C2 and £3 are being used. .Rather; than asking what is going on in the class, this 
calls for asking what kind of- activity, with whom; and when, is the individual 
child involved * Thus, if the- child is engaged in an activity with four other chil- 

+ I 

‘ V 

dren, it will be. entered in; the . third row (from the top). When using the protocol 
in this way, there will only .be one entry per column (or time interval) as the 
child cannot be in a group and. .functioning individually at the same time<> How- 
ever, the organization of the . class into group or individual activities can be 
noted with checks in appropriate, cells* 

The observer can elaborate on the protocol, underneath the entry, in order 
to provide more detail. 

As with the classroom: use of . this protocol, the number of children in at- 
tendance and the number of adults working with. children should be recorded in each 
time interval* 

The time interval of ten. minutes, is. an educated guess* This means that we 
can observe approximately four or ..five children per hour, leaving some time for 
switching children, note taking and completing ratings* If observer stays the 
whole three hour period, .he can get*. three ten minute recordings on each of four 
or five children* We can vary the. length of time interval, the number of times 
we observe a given child in. a day. (and consequently the number of children that 
are observed, in a day)* The. important point here is that whatever the interval, 
we should always get two or three separate time intervals on each child selected 
in a given day. 
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INSTRUCTIONS FOR: RECORDING BEHAVIOURAL CATEGORIES FOR TEN MINUTE 

OBSERVATIONS! OF INDIVIDUAL. CHILDREN (Cl and Dl) (sea pp. I9,..2l)„ 

• • ■ 

Five icilH) each with; five categories (with one exception, 5) are to be used 
in making entries every thirty sec&nds for ten minute periods. Again, the selec- 
tion' of thirty second: intervals listen .educated' guess. We will see how it works 
end reduce it,or expand it accordingly. All scales ere ordinal with categories that 
ere not' meant to- be all incluslve^but are mutually exclusive. 

The control scale is directed „ to the source of initiating and terminating 
activity, and also to the dynamics. .of the continuing activity (the sequence scale. 
_1). Essentially, it asks the question, of choice.. If the child is in the midst of 
an activity. and is. being. directed, ..corrected, and. helped. by. the teacher, then the 
recorded, value would.be L or JJ* ... If. the child, is. a part of the decision process, 
or if he is allowed to proceed. without, too. much. assistance, .then the value would 
be 4 or 5. A + or a - sign in the.. lower right hand triangle of each cell will 
indicate the observer's judgment of.. the appropriateness of the control. 

The participation scale; (3) focuses on the involvement of the child in what- 
ever he is doing, whether it be desirable or undesirable behaviour. This scale 
asks questions of both, intensity and.. direction. Therefore, it is clear that "ac- 
tivity" must be defined during..eacht.time interval. For a very active child it 
may be, at times, difficult to .determine which end of the s^ale to place him. 

The question is whether a. child cad reject an activity that he has initiated and 
which he is continuing to. control*... 

In order to get out of this bind, we. have included Behaviour of child (4), 
which requires no activity antecedent, but is simply a question of intensity. 

Teacher style (5) refers*. to. the style with which the relevant adult (teacher) 
controls and reinforces (or inhibits) .behaviour, or .at least .attempts .to* There 
is an Important distinction between £ and 3. In 3, the child is being attended 
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to, but thin is littls.or. no apparent response* 0, iiipliss that ths child is out- 
aids of ths teacher* s field of rettention:.(end possibly vision). 

INSTRUCTIONS : TOR RECORDING PROTOCOL FOR SELECTED 

TIME VARIABLES (C2) (see pp. 1?, 22) 

Entries in scales £, 2 end JJ. are straightforward recordings of the presence 
and direction: of ' teacher-child, and.'. child-child Interactions that take place in 
f if teen-aheond intervals*: / Scales 2* 2# 2 and 2 * r * related. in that attention is 
giniric to verbal coaaunication*. .Both can take place when the child is function- 
ing individually (with regards to peers) or in a group. When the teacher talks 
to the group , without reference to .the child » and without specific response by 
the child, it is scored 0. Similarly, attention must involve the child, in par- 
ticular, or else it is scored. 0. 

Scales 2 and 2* comaunication child-child and attention child-child, refers 
to conversation and non-verbal communication between child and one or more peers, 
where there is mutual responsiveness. 

INSTRUCTIONS FOR. RECORDING PROTOCOL FOR RATING TEACHER 

BEHAVIOURAL STYLE (C3I (see p. 20) 

* * .... * * ... 

A rating' on each* of' seven* characteristics - is' to - be' made* at the* conclusion 
of each ten-minute observation -of .an .individual child. The "teacher" here is the 
teacher, aide,' volunteer:. or:.student. .teacher*, .who' has had most contact with the 
child, either while the child . ia .in a group situation, or when he is alone with 
the teacher* If several adults have contact with the child, rate the adult who 
has the longest contact in the -ten minute interval. If several adults have equal 
time, then rate only the- first.. one*. . If no adult has had any contact with the 
child, or if the contact: has .been euperficial and of extremely short duration 
(less than ten seconds) * then score it as j 32 & ftpplicabja, (2)* 
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As s matter of procedure , the observer should make checks under i » 2. or ,-L 
in each of the categories whenever there is contact , according to whether the con- 
tact is an example of the category behaviour, or whether the behaviour is not ap- 
parent. 

The purpose of these scales is to get at behaviours that are obviously im- 
portant, but which are not easily categorized and recorded. We are primarily 
asking the question of presence or absence, but we have inserted an intermediary 
point because of the likelihood that there will be ambiguity. Values of 3, and 1 
are clear indications that the behaviour has been shown or not. The behaviour does 
not have to be sustained over the ten minute interval, but it has to be clearly 
present, and a part of the teacher's behaviour, vis-a-vis the children or child, 
in order to be scored. These scales can be just as readily scored if the child is 
in a group for the interval as if he is in a one to one situation with the teacher 
for all or part of the interval* 

Since potentially each scale. can be represented by a bipolar contlsmious scale, 
each rating will consist of two poles plus an intermediary value. For example, when 
rating humour , the first question is whether the teacher displays humour in her 
dealings with the child or the group that the child is in, for all or part of the 
ten minutes. If the answer is no, then the teacher is rated 1,. If yes, then the 
question is asked as to whether .it* is occasional and somewhat ambiguous, in which- 
case the rating is 2. If the display of humour through facial expressions, words 
or laughing is obvious (although not necessarily continuous), that is, if it takes 
place in more than a fleeting instant, it is recorded as 3,. If the teacher has no 
opportunity to display humour or not to display humour, then the rating is 0,, which 
stands for not applicable. 



Curriculum Protocol for 20 minute observation of Class (or individual child in class) (A) 
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Key for scoring classroom and child 
Curriculum Protocol (B) 



0 


1 


2 


3 


4 


5 


Curricular 
Classification 
(Not to be 
coded) 


Substantive or activity 
Category 


Process 

FOCU8 


Control 
(with regard 
to child) 


Sequence 




Primary 


Secondary 










Co: Construction 


Ae: Aesthetic 


Me: Mechanist 1 


*• 






(01) 

(Wood, paper, 
clay, blocks, 
painting , 
collage, cook- 
ing, etc.) 


(1) 

Fu : Functional 

(2) 


routine 

(1) 


P : Passive 

Teacher 


I: Initial 


I 




Sk: Skill 

Manipulative 
(2) 


dominated 

(1) 


(1) 


Activity 










focus 

(Ac) 

(Focused on 
activity 
rather than 
substantive 
content) 




Mu: Music (1) 








Pe : Performing 

(or being per- 
formed to) (02) 
(Music, role 
playing, puppets, 
television, 
house-keeping, 
games, etc.) 


Do : Dramatic 

play (2) 


?e: Perceptual 






Ga: Games (3) 


(3) 


M: Mediated 

Control 


C: Continuing 




Co: Cognitive 


between child 
and Teacher 


(2) 








(2) 








Sm: Small Mus- 


Language 

(4) 








Py: Play (03) 

(Water, sand, 
clay. Swings, 
slides, jungle- 
jitns) 


cle (1) 

Lra: Large Mus- 


















cle (2) 

Cx: Complex (3) 


So: Social 

emotional 
(5) 


A: Active 












Child 


T: Terminal 






Ex : Exploring 




dominated 

(3) 


(3) 




Un: Undefined 


(i) 


Na: Not 








(Wandering) 

(00) 


In: Interactint 


applicable 


* 






(2) 

No : No defini’ 

tion (6) 


(0) 








0 - Not defined, not applicable. 
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Key for scoring classroom and child 
Curriculum Protocol (jB contd.) 



B 



0 


1 


2 


3 


4 


5 












mJ 


Curricular 
Classification 
(Not to be 
coded) 


Substantive or activity 
Category 


Process 

Focus 


Control 
(with regard 


Sequence 


Primary 


Secondary 




to child) 






Sc: Science 

(04) 
(Biology, 
physics, 
chemistry, 
botany, 
zoology) 


Tx : Textual 

(1) 

(Labelling, 

memorizing, 

discriminations) 


Me: Mechanic- 

tic, 
routine 
(1) 


P : Passive 


I: Initial 


II 


Sk: Skill 

Manipulative 
(2) 


Teacher 

dominated 

(1) 


a) 


Substantive 

(Su) 










(Focus on 
substantive 
content rath** 


Qu: Quantita- 

tive (05) 
(Numbers , 
sizes, shapes. 




Pe: Perceptual 






er than ac- 
tivity) 


puzzles) 


De: Demonstration 


(3) 


M: Mediated 

Control 


C: Continuing 






(2) 




between 






La: Language, 

Verbal 


(experimental, 

implications) 


Co: Cognitive. 


child and 
Teacher 
(2) 


(2) 




(06) 

(Speech, dis- 
cussion, 
stories, writ- 




Language 

(4) 






ing, reading) 




So: Social 

emotional 
(5) 








So : Social 

relations 


Ex: Experimental 


A: Active 


T : Terminal 




(06) 


(3) 




Child 




(Interpersonal 
relations, cul- 
ture, social 
organization, 
history, govern* 
ment, community) 


(Direct involve- 
ment, trans- 
formations) 


Na: Not 

applicable 
(0) 


dominated 

(3) 


(3) 



i 




0 - Not defined, not applicable. 
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Kev for scoring classroom and child 
Curriculum Protocol (II contd • ) 



0 


1 


2 


3 


A 


5 


Curricular 
Classification 
(Not to be 
coded) 


Substantive 

Categ 


or activity 
jory 


Process 

FOCU8 


Control 
(with regard 
to child) 


Sequence 


Primary 


Secondary 










Sn: Snacks 




4e: Mechanist i< 


» 






( 08 ) 

(Juice, lunch) 




routine 

(i) 


P : Passive 

Teacher 


I: Initial 










dominated 

(1) 


(1) 


1 


Cu: Clean Up 

(09) 


Fu: Functional 

(1) 


Sk: Skill 

Manipulative 

(3) 










Pe: Perceptual 
















III 






(3) 


Ms Mediated 




Routines 


Re: Rest 




Control 


C i Continuing 






between child 


(2) 


(Ro) 


(10) 




Co: Cognitive 


and Teacher 
(2) 








Language 

(A) 








0 : Other 


El : Elaborative 


So: Social 








(ID 

(Arrival, 

daparture, 

toileting, 

washing, 

dressing) 










(2) 


emotional 

(5) 


A: Active 

Child 


T : Terminal 






Na: Not 

applicable 


dominated 

(3) 


(3) 








(0) 







I 



1 



ii 



ii 



ii 



ii 



ii 



ii 



I 



i 



I 



I 
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0 - Not defined, not applicable. 
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Category Scales for Time Sampling of Individual- 
Child Classroom Behaviour (Dl) 

i 

1. Sequence of behaviour: I - initial; C - continuing; T - terminal 



2, Control of activity 



Teacher Direction 


Teacher 


Teacher 


Teacher 


Child 






Presents 


Child 




and insistence 


Suggestion 


Alternatives 


Collaboration 


Controlled 


1 


2 


3 


4 


5 



3* Participation of child in activity 



Rej ection 


Reluctance 


Indifference 


Moderate 

Involvement 


Intense 

Involvement, 

absorption 


1 


2 


3 


4 


5 



4. Behaviour of child 



Passive 

Non-responsive 


Compliant 

Participation 


Active 

Exploratory 


Verbally 

Aggressive 


Physically 

Aggressive 


1 


2 


3 


4 


5 



5* Teacher style of approaching, directing, and responding to child (T) 



i 

Not attending 
to activity 
or task 
in any way 


Severely 

punitive, 

physical 


Verbal 
punitive, 
sarcasm, in- 
timidation, 
ridicule, 
threat, 
coercion 


Permissive, 
attending to 
but non- 
committal, 
uninvolved 


Enabling, 
reassurance, 
encourage- 
ment, construc- 
tive, criticism 


Unequivocal 
and indis- 
criminate 
support , 
over 

indulgence 


0 


; 

l 


2 


3 


4 


5 



i 

i 
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Scales for Time Sampling of Individual 
Child Classroom Behaviour (D2) 

6. Attention: Teacher to Child ( 1 and Child. to Teacher (s^ — ) and two- 

way interaction (\' /) 

7. Verbal communication: same as #6. 

8. Attention: Child - Child 

9. Verbal communication: Child - Child. 

(Presence [V] or absence [ 0] to be scored every 15 seconds.) 



IP 
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E & ER Observation., of Classea 
Time Allotments 



The following chart gives, an estimate of the sample: 



i 





E 


ER 


Total 


No. of Children: 


75-100 


45-60 


120-160 


No. of Classes: 


5-10 


4—8 


9-18 


Mean No. qf Classes 


8 


6 


14 


Mean No. of Children/ 
Class 


10 


10 


140 



Time allotment: 30 hours/class .with two observers or 

60 observational hours/ class equals total of 840, 

Time Allotment for Curriculum Period 



Three 3 hour observations/class equals 9 observation hours/class 



(assuming 14 classes) 9 x 14 equals 126 

Extra observers for highly differentiated classes 30 

156 ' 

Time Allotment for Individual Child Observation 
3 hours/child overall (140 children) (756) 

2 hours/child overall 504 

1 hour /child overall (252) 

Training and exploratory observation 180 

840 



Observation of individual children will take more days than observation of 
class. Suggested guideline: Each child should be observed on at least one cycle 

(three 10 minute intervals in a single day) concurrently with observation of class 
(Curriculum Protocol) ; this would leave three cycles which would take place without 
concurrent administration of curriculum protocol. 
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Time for Individual Child Observation 



Options on total time, . as suming a 3 hour observation period, will net two 
hours of protocol time per day (four 1/2 hour observations per day). 



Total net time each 
child is observed 
in hours 


No. of 
cycles 


No. of 10 min. 
observations 
3/cycle 


Total hours for 
sample, assuming 
an average of 14 
classes. 140 children 


1 


2 


6 


252 


2* 


4* 


12* 


504* 


3 


6 


18 


756 



^Recommended 



Model for each class (assuming 12 children from class in sample) 



Sub Samples : A 

B 
C 

Two cycles will give one hour of observation per child in ten minute inter- 
vals, in two separate days. 

Four cycles will give two hours of observation per child. 

Six cycles will give three hours of observation per child. 

Each cycle will take three 3 hours per day or 9 observer hours per class. 
Total time for completing is 9 X number of cycles x number of classes. 



Cvclee 


i - Days 


1 


2 


3 


4 


5 


6 


4 


4 


4 


4 


4 


4 


4 


4 


4 


4 


4 


4 


4 


4 


, .4 


4 


4 


4 



Observation of individual children will be rotated as follows: four chil- 

dren out of the sample in a given class will be selected for a given day's (3 hours) 
observation. Children will be assigned numbers and the four will be selected from 
the sample in the class. There are several possible procedure**: 

1. The four can be rotated in straightforward fashion for the three hours - 
1, 2, 3, 4; 1, 2, 3, 4; 1, 2, 3, 4 - four children to be observed in an hour leaves 
20 minutes per hour for finding next child, completing protocols, etc. This can 
roughly be spaced as follows: 10,5,10,5,10,5,10,5 equals 60 minutes. 
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2 e The sample in each class can be randomly assigned to observation peri- 
ods and observation would continue until each child had been observed for a given 
amount of time. Using this procedure, it would be possible for a child to be ob- 
served 0 to 12 times on a given day. 

Method #1 is procedurally easier, but method #2 is theoretically more sound, 
as it eliminates bias due. to observation dependency * Method #2 would give unbi- 
ased estimates of child-peerrteacher activity interaction; therefore, it would 
be more defensible to accumulate..ratings for children in a given class in order 
to get measures of total class functioning. 

It would further strengthen* the' possibilities' for 'inference' if days for 
observation were selected ..using a random or stratified random procedure. It would 
seem that since the number of classes per center will be modest, it might be rea- 
sonable to do it in this way. 

Ideally the procedure would go as follows: 

A sample of class days would be. randomly selected from all possible class days, 
stratifying on- beginning (Monday), middle (Tuesday, Wednesday, Thursday) and end 
(Friday) of week and probably ignoring vacation and party days (either eliminate 

% i 

them entirely or take no cognizance of them and Include them as they are selected) . 
Trip days can either- be eliminated entirely or included as they come up. The 
latter is theoretically preferable, but might present practical problems. Data 
from classes that include trips as a major part of their program would be biased. 
The individual child scales have been constructed so that they can be used for any 
activity that may be going on* The decision to include or exclude trij: days 

should be made after the explanatory observation. Other considerations might al- 
so come up at that time. 
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Exploratory Observation :.and Training 

Ona hundred eighty hours are to be used for exploratory observation and 
training, to be divided up 30 and 150. Exploratory* observation is for the pur- 
pose of getting preliminary data that can be used in: 

1. Sample. selection 

2. Determination of .stratification variables. 

3. Determination of ..restrictions and exclusions. 

If the sample of available classes is considerably larger than 14, it might, 
be necessary to do preliminary .observation in order to obtain the 14 classes to 
be used in the sample. Thls.depends on between class variability that is de- 
sirable for the final sample of classes. 

In order to set up an.overall observational schedule, it will be necessary 
to observe each of the 14 classes on two separate occasions for approximately 45 
minutes each, one observation to be in the first half of the school day, the 
other to b* in the second. half. This will provide information both from obser- 
vation and interviewing the teacher on the following: 

1. Overall schedule of class, intra and inter day variability, trips, expected 
attendance, days when observation would not be feasible, classroom organization, etc. 

2. Amount of differentiation (as opposed to total or small group) in class. 

3. Feasibility of havlng.more than one observer in the room at a time. (Probr 
ably the more highly differentiated classes, which might require more than one ob- 
server for the curriculum protocol , will be the classes that can most reasonably 
be expected to be able to have more observers without interrupting the program). 

It is estimated that this will involve a net of two hours which can be done 
by two observers in a week as follows: 



I 



1 
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Observers 



M 


T 


... W. 


Thurs . 


Fri. 


1,2,3 


A, 5, 6 


7,8,9. 


10,11,12 


13,14 


7,8,9 


1,2,3 


13,14 


4,5,6 . 


. 10,11,12 



Class numbers are 
Inserted in cells. 



Including travel time, this will gross out at 30 hours. 

Alternatively, each observer can visit seven classes, each twice, which will 
give the same net and gross hours, but which may be more practical, because on the 
second visit, the observer will already be familiar with the setting. The first, 
procedure has the advantage of .observation on each class by different observers. 
This leaves 150 hours for training observers. 



. Selection of Observers 

It is expected that individuals with experience and training in the educe* 
tion of pre-school children will.be included in the team of observers. This is 
not to say that it is necessary (or even desirable) that all observers have. such 
training and experience, but that pre-school education and experience will be 
represented. 

Utilizing films, all observers can be screened on their ability to record 
accurately curricular and behavioural sequences. Although much has been done in 
the development of this observational strategy to reduce observer effects, it will 
be necessary to continually quality control the process by using films and two-way 
observational set-ups where many observers can rate the same activity. 

Analysis of Datji 

Characteristic curves of classes and clusters of classes in terms of dif- 
ferentiation (vertical axis .of curriculum protocol . A) X time (horizontal axis 
of curriculum protocol) . will be .mapped* These curves can be compared with ref- 
erence . to control (B-,4 and J>_l-g) , process focus (B-3) , participation (Dl-3) and 
teacher style (Dl-5) across curricular classifications (B-0) and primary and 




secondary substantitive or activity categories (B-l, and B.-2) , 
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By utilizing curve fitting methodologies and, possibly, multiple discrim- 
inant function analysis, maximally different- functions can be calculated and de- 
scribed in order to set . up . hypotheses about .goals that can bh inferred from ob- 
servational data - that is, goals that are assumed to exist because of what goes 
on in the class. In more straightforward terms, this analysis will develop specT 
ific predictions for single, children, classes and clusters of classes regarding 
probabl effects' of various. kinds of programs on children. The first question..to 
be attended to is, if a given.*-class (or cluster of classes) is affecting children, 
what kind and degree of effects are most likely? It may be that, for some ..of .the 
clusters, we will not have ..measurements suitable for obtaining data on behaviours 
that appear to have the most possibility of changing. It will be possible, to 
make probability estimates that any given class, when compared to any other class, 
whill show child changes in particular areas. The categories used for the cur- 
riculum protocol (B) will.. provide a basis for connecting classroom procedures, 
with individual child behaviours. Control (Dl-2) , participation (Dl-3) and teach- 
er style (Dl-5) will provide data on how curriculum is presented and how it is 
received, thus allowing for inferences about not only what is being presented to 
the child, but how it .is expressed and how it is received. 

Observational recordings can be used for obtaining individual child measures 
as well as class measures. When a. prediction about change is made for a given 
class, it can be mediated by the data obtained on Individuals in that class. Thus, 
we will not have to rely on global predictions exclusively. The hypothesis that 
a child who has been exposed to a considerable amount of a particular kind of cog- 
nitive content will change cognitively will be mediated (different hypotheoea-for 
different children or clusters of children) by variables of the behaviour proto- 
cols (Cl and. £2). 

Time variables (C-J2 and D-2) provide quantitative data. on an aspect of 
participation (Cl-3 and Dl-3) , and also an aspect of curriculum (B-JrA * nd BII- 1-6) . 
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For any givan curriculum, tha tima variablaa;wlllprovide varlflcatlon or raj action 
of tha obeerved goala, ,in .tarma .of .particular children. 

Tha teacher protocol : (C3) , coneiete of eaven..ecalee» tha data on which will 
be analyzed aeparately, in order to iaolata two or three factore. Resulting fac- 
tot acoraa ons teachers will. .be .used to further mediate the evaluation of atten? 
tion as it applies to children* We have already diacueeed the : queationa of ..how, 

both for th# .teacher and for. the. child* For given how-how interaction#, we aak 

► 

whether there ia corresponding ay a tana tic variation on certain aapecta of judged 

) 

t aachet style* The aim.of ..these analyses ia to explore the quaetlon: what kind 

of teacher (or teaching) will. get what kind. of attention? The "kind of teacher'. 1 
(or "teaching") ia gotten at ..by the teacher . protocol - (C3) and alao by £1-2,, £t£ 
and, more generally, from. the .curriculum protocol A 4nd 1) • ,lKind attention' 1 
la explored in participation (Dl-3) , behaviour (Dl~4) and the time variable# 

(C2 and D2)c 





